State Comparisons.     Repeatedly,  papers  remind us   that  school policymaking
occurs at the  local and State levels.     Writers warn that  the  federal data
gatherers  must constantly keep  this  in mind and should understand and plan
their data  collection  around State  and local policymakers who want   to be  able
to assess  how  their State  or local school district  is doing   in   comparison to
other States  and districts.     The  lack  of  comparability  today,   however,
prevents  these  comparisons from being  made  with much meaning  or precision.

The problem of  lack, of comparability is pervasive  in data gathering  in
general,   but  is especially critical   in education.     Virtually  everyone points
this out in regard  to  one of  the inputs or  outcomes that must be  measured.
There are  repeated pleas  for common definitions,   so many   that  it  appears   that
if  NCES did nothing else but devise a  system for  collecting  data  in a way  that
makes meaningful State-by-State  comparisons possible,   it will make many people
very happy  (see for example,   Buccino,   Usdan,   W.   Turnbull,   Bishop,   and  others).

Yet,   to  compare  two  things,   it  is  necessary  for  them to   have   some   shared
characteristics.     This basic premise cannot   be  fulfilled with  any   certainty
when comparing  schools,   however.     The  basic   entities  involved  in  the
comparison are  frequently very different.     For example,   the  use of  SAT scores
to   compare  achievement levels  across schools  or States  is  meaningless,
if   the social,   racial,   and economic backgrounds of   the student populations   is
not taken  into account   (Cronin,   Bishop).     Disparities similar to  this  occur  in
virtually  every aspect  of  education  that  is   measured.     This problem  is
especially significant when comparing educational  inputs and  outcomes.

Bishop suggests that NCES work cooperatively with the States to insure that
data are consistent with common definitions. If the specific data elements
are not comparable (i.e., if they are interpreted differently), they should
either not be published or published with a footnote describing reasons for
the lack of comparability. National aggregates should also only be reported
for the States that have provided comparable information.
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o The quality of effort,  materials,  and time;   and
